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SOLID-STATE IMAGE SENSOR 

This application is based upon and claims the 
5 benefit of priority from the prior Japanese Patent 
Application Nos. 2002-216848 and 2002-316280, 
respectively filed in July 25 and October 30, 2001, the 
entire contents of which are incorporated herein by 
reference . 

10 BACKGROUND OF THE INVENTION 

The present invention relates to a solid-state image 
sensor. More particularly, the present invention relates 
to a solid-state image sensor that reduces flicker noise, 
due to a fluorescent lamp, during indoor shooting. 

15 Image sensors include an image pickup tube and a 

solid-state image pickup device (solid-state image 
sensor), and most of them are a storage type except for 
special ones used to observe high-speed phenomena. A 
storage type image sensor stores signal charges 

20 corresponding to an incident light image in pixels, which 

are read sequentially in a scanning manner and become an 
output signal current. Each pixel stores the signal 
charges during the period of scanning cycle. 

Recently, a solid-state image sensor has been used 

25 as a built-in device in many products such as digital 

cameras and portable terminals. The solid-state image 
sensors include a CCD type solid-state image pickup 
device (CCD type image sensor) composed of a charge 
transfer type image sensor and a CMOS type solid-state 

30 image pickup device (CMOS type image sensor), the image 

sensor of which is composed of CMOS transistors. The CMOS 
type image sensor can be manufactured with the same 
technology as the MOSFET manufacturing process and is 
expected to replace CCD image sensors because it can be 

3 5 driven by a single power source, its power consumption is 
small, and various signal processing circuits can be 
mounted on a single chip. The present invention is 
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applicable to any solid-state image sensor, that is, both 
to a CCD type image sensor and a CMOS type image sensor. 
A CMOS type image sensor is particularly described here 
as an example, but the present invention is not limited 
5 to this. 

The CMOS image sensor has plural pixel areas 
arranged in a matrix which are connected to plural 
vertical selection lines and horizontal selection lines 
and. In each pixel area, photoelectric conversion devices 

10 such as a photodiode are formed. The light incident on 
the light receiving surface of each photoelectric 
conversion device is photoelectrically converted and 
charges are stored in the device. The stored charges are 
amplified by a source follower amplifier or the like 

15 provided within each pixel and are read as image data for 
each pixel at a fixed timing. Plural pieces of image data 
connected to the fixed horizontal selection lines are 
output at one time in response to the row selection 
signal from the vertical scanning shift register, and 

20 then are output sequentially to the external system side 
from the horizontal shift register in response to a 
column selection signal. 

As the solid-state image sensor used in digital 
cameras and portable terminals cannot adjust the amount 

25 of incident light by means of an optical aperture or the 
like, it is required to be equipped with an automatic 
gain control function with which to automatically adjust 
an output in accordance with the brightness (illuminance) 
when shooting using the solid-state image sensor. In one 

30 of the most general methods of automatic gain control, 
the amplifier at the output section of a solid-state 
image sensor is replaced with a gain-variable amplifier 
and a constant output level can be always obtained by 
varying the amplification factor (gain) of the amplifier 

35 in accordance with the highest level or average level of 

an image. 

In another method of automatic gain control, the 
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storage time is varied. As described above, each pixel of 
a solid-state image sensor stores charges from the time 
it reads a signal until it reads a signal next. This 
storage time relates to the sensitivity, that is, the 
5 shorter the storage time, the less charge is stored, 

resulting in degradation of sensitivity. Recently, the 
solid-state image sensor has been equipped with a 
function with which to reset charges stored in each pixel 
in a unit of a row, therefore, the storage time can be 

10 shortened arbitrarily. The function to vary the storage 

time is utilized in the automatic gain control. 

FIG.l and FIG. 2 are diagrams illustrating the 
automatic gain control in a conventional CMOS image 
sensor. FIG.l shows adjustment of the number of integral 

15 lines corresponding to the storage time and FIG. 2 shows 

adjustment of gain. In FIG.l and FIG. 2, the lower graph 
shows an enlarged part of the upper graph in the 0 to 
2000 range of the value of brightness. It is assumed here 
that the CMOS image sensor has 512 rows and each pixel 

20 data is read at a 30 Hz read cycle. Therefore, the 

storage time is 1/30 sec. at most and the number of 
integral lines is 512 in this case. If the storage time 
is shortened the number of integral lines becomes less 
than 512 accordingly. 

25 The value of brightness is data of the detected 

amount of light incident on the CMOS image sensor and 
expressed in, for example, 14-bit data, that is, the 
value ranges from 0 to 1616384. The value 0 means the 
maximum brightest and as the value increases the 

30 brightness becomes lower. As shown in FIG.l and FIG. 2, 

while the value of brightness varies from 0 to 1000, the 
number of integral lines is increased to increase the 
sensitivity. When the value of brightness varies and 
exceeds 1000, the gain is increased with the number of 

35 integral lines being fixed to the maximum value. 

In the case of indoor shooting, a fluorescent lamp 
is frequently used for illumination, but it is known that 
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shooting under the illumination of a fluorescent lamp 
causes flicker noise in images due to the flicker of the 
fluorescent lamp. The amount of emitted light of a 
fluorescent lamp varies at a frequency twice that of the 
5 power supply frequency. Therefore, in an area where the 
power supply frequency is 50Hz, the amount of emitted 
light of a fluorescent lamp varies at 100Hz, and in an 
area where the power supply frequency is 60Hz, it varies 
at 120Hz. The relationship between the light emission 

10 frequency of a fluorescent lamp and the storage time of a 
solid-state image sensor brings about a problem. 

FIG. 3 is a diagram illustrating the occurrence of 
flicker noise, and (a) shows a case where the light 
emission frequency is 100Hz and (b) shows a case where 

15 the light emission frequency is 120Hz. The signal storage 
of the photodiode of a pixel connected to the x-th 
horizontal selection line (referred to as the x-th line 
hereinafter) from the top of the first frame is described 
below using FIG. 3. Let the signal storage beginning time 

20 at the x-th line be lxb, the signal storage ending time 

be lxe, and the signal storage time (integral time) be 
ts. If the total of the vertical scanning period and the 
vertical blanking period from the first horizontal 
selection line to the last one is assumed to be one frame 

2 5 period T, one frame period T=l/3 0 sec, for example, 
therefore, the frame frequency f=30Hz. 

As shown in FIG. 3 (b), when the light emission 
period of a fluorescent lamp is 1/120 sec, an integer 
multiple (quadruple) of the light emission period of the 

30 fluorescent lamp coincides with one frame period of the 
CMOS image sensor. Therefore, the timing of the signal 
storage beginning time lxb and the signal storage ending 
time lxe at the x-th line is the same in the n-th frame 
and the next (n+l)-th frame with respect to the light 

35 emission period of the fluorescent lamp. As a result, 

shooting under the illumination of a fluorescent lamp 
whose light emission frequency is 120Hz causes a constant 



- 5 - 



brightness of an image in each frame. 

As shown in FIG. 3 (a), on the other hand, when the 
light emission period of a fluorescent lamp is 1/100 sec, 
an integer multiple of the light emission period of the 
5 fluorescent lamp does not coincide with one frame period 

of the CMOS image sensor, which is approximately 3.3 
times the period in this example. Therefore, unless the 
signal storage time ts is adjusted to the light emission 
period of the fluorescent lamp, the timing of the signal 

10 storage beginning time lxb and the signal storage ending 
time lxe are not the same in the n-th frame and the 
(n+l)-th frame with respect to the light emission period 
of the fluorescent lamp. As a result, shooting under the 
illumination of a fluorescent lamp whose light emission 

15 frequency is 100Hz causes the brightness of an image to 
differ from frame to frame, resulting in the occurrence 
of flicker. 

FIG. 3 shows a problem of a relationship between 
frames, but in the case of the signal storage of pixels 

20 connected to different horizontal lines in the same 

frame, the timing is not the same with respect to the 
light emission period of a fluorescent lamp for both the 
light emission frequencies 100Hz and 120Hz. As a result, 
there occurs difference in brightness in each row in the 

25 same frame for both the light emission frequencies 100Hz 

and 120Hz, resulting in occurrence of bright and dark 
stripes in an image. It is necessary to set the storage 
time to an integer multiple of the light emission period 
of a fluorescent lamp in order to avoid the occurrence of 

30 flicker and stripes due to shooting under the 

illumination of a fluorescent lamp. 

Conventionally, such a problem is solved by setting 
the storage time to an integer multiple of the light 
emission period for 50Hz and 60Hz, respectively, when the 

35 value of brightness is 1000 or greater, but a problem 

still persists that flicker and stripes are caused in the 
0 to 1000 range of the value of brightness because the 
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storage time is varied in this range. However, in an 
actual use, as the intensity of illumination is small 
when indoor shooting is carried out under the 
illumination of a fluorescent lamp, that is, the value of 
5 brightness is 1000 or greater in most cases, the method 
of sensitivity adjustment as shown in FIG.l and FIG- 2 
brings no serious problem. 

However, there are areas with power supply frequency 
of 50 Hz and areas of 60Hz in Japan, and the storage time 

10 is set on shipping in accordance with the supposed 
destination of the product. However, a problem of 
occurrence of flicker and stripes persists if the power 
supply frequency is inappropriate. 

In order to solve such a problem, the present 

15 applicants have disclosed a configuration in Japanese 

Unexamined Patent Publication (Kokai) No. 2002-330350, in 
which flicker in the illuminating light is detected from 
the output signal of the solid-state image sensor, 
whether the illumination is provided by a fluorescent 

20 lamp lit at 50Hz or 60Hz, and then the storage time is 

set to a value in accordance with the light emission 
period of the fluorescent lamp. 

Moreover, Japanese Unexamined Patent Publication 
(Kokai) No. 10-304249 has disclosed another method for 

25 reducing flicker noise. 

Recently, the solid-state image sensor, particularly 
the CMOS image sensor has improved in sensitivity, 
therefore, the sensitivity adjustment cannot be carried 
out sufficiently unless the integral time is varied, even 

30 for indoor shooting under the illumination of a 

fluorescent lamp, that is, the illumination in which the 
light intensity is relatively small. 
SUMMARY OF THE INVENTION 

It is an object of the present invention to solve 
35 these problems and realize a solid-state image sensor in 
which sensitivity can be adjusted in a wide range without 
occurrence of flicker or stripes due to the illumination 
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by a fluorescent lamp. 

In order to realize the above-mentioned object , in 
the solid-state image sensor of the present invention , 
sensitivity is adjusted using both the storage time and 
5 the amplification factor of the amplifier. To this end, 
the solid-state image sensor of the present invention is 
characterized in that a gain variable amplifier is used 
as an amplifier, which amplifies a signal read from a 
pixel, a brightness/illumination flicker detection 

10 section is provided, which detects the brightness and the 

illumination flicker of an incident light image, and 
while the storage time is varied, step by step, to one of 
plural flicker-less times without occurrence of 
illumination flicker in accordance with the detected 

15 brightness and the illumination flicker, the 

amplification factor of the gain variable amplifier is 
varied in accordance with the detected brightness and the 
set value of the storage time. 

As sensitivity is adjusted using both the storage 

20 time and the amplification factor of the amplifier, the 

solid-state image sensor of the present invention has a 
wide adjustable range. The storage time is varied step by 
step to a flicker-less time without occurrence of flicker 
for 120Hz or 100Hz by detecting illumination flicker in 

25 order to prevent flicker or stripes from occurring even 
if the storage time is varied, and the total sensitivity 
varies smoothly by using the amplification factor of the 
amplifier simultaneously as the storage time is varied 
step by step. 

30 When the illumination flicker has a 100Hz light 

emission period, which is the period when a fluorescent 
lamp is operated at 50Hz, the storage time is set to 
n/100 sec (n is 1, 2 or 3 ) , and when the illumination 
flicker has a 120Hz light emission period, which is the 

35 period when a fluorescent lamp is lit at 60Hz, the 

storage time is set to n/120 sec (n is 1, 2, 3 or 4 ) . 
The brightness/illumination flicker detection 
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section can be realized by the configuration disclosed in 
Japanese Unexamined Patent Publication (Kokai) No. 2002- 
330350, in which the average luminance of a pixel signal 
is detected in each frame in the fixed average luminance 
5 detection area assigned in a frame, the difference in the 
average luminance between frames is calculated, and 
whether the illumination flicker is due to a fluorescent 
lamp operated at 50Hz or 60Hz is judged from the 
difference in the calculated average luminance. However, 

10 the present invention is not limited to this, and any 

detection method can be used as long as it can detect the 
brightness and the illumination flicker of an incident 
light image. 

BRIEF DESCRIPTION OF THE DRAWINGS 

15 The features and advantages of the invention will be 

more clearly understood from the following description 
taken in conjunction with the accompanying drawings in 
which : 

FIG.1 is a diagram showing the variation in the 
20 number of integral lines in a conventional example of the 
automatic gain control of a solid-state image sensor; 

FIG. 2 is a diagram showing the variation in the gain 
of the amplifier in a conventional example of the 
automatic gain control of a solid-state image sensor; 
25 FIG. 3 is a diagram illustrating a problem of flicker 

due to illumination of a fluorescent lamp; 

FIG. 4 is a diagram showing the configuration of the 
CMOS image sensor in the embodiments of the present 
invention; 

30 FIG. 5 is a diagram showing the variation in the 

number of integral lines in the automatic gain control of 
the solid-state image sensor in the embodiments; 

FIG. 6 is a diagram showing the variation in the gain 
of the amplifier in the automatic gain control of the 
35 solid-state image sensor in the embodiments; 

FIG. 7 is a diagram showing the control values when 
the power supply frequency is 100Hz for the automatic 



- 9 - 



gain control of the solid-state image sensor in the 
embodiments ; 

FIG -8 is a diagram showing the control values when 
the power supply frequency is 120Hz for the automatic 
5 gain control of the solid-state image sensor in the 

embodiments ; 

FIG. 9 is a flow chart of the processing for 
detecting illumination flicker; and 

FIG. 10 is a diagram showing the average luminance 
10 detection area for the processing for detecting 
illumination flicker . 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
FIG. 4 is a diagram showing the configuration of the 
CMOS image sensor in the embodiments of the present 
15 invention. 

FIG. 4 shows a circuit example of 4x4 pixels of a 
CMOS image sensor 1 that has a pixel array with m rows 
and n columns. Pixel areas Pll to P44 to be connected to 
plural vertical selection lines CL1 to CL4 and horizontal 

20 selection lines RW1 to RW4 are arranged in matrix. In 

each of the pixel areas Pll to P44, a photodiode 10 is 
formed as a photoelectric transfer device. The 
photoelectric transfer device can be realized by, for 
example, a photo gate instead of the photodiode 10. 

25 The CMOS image sensor has an APS (Active Pixel 

Sensor) configuration, in which a source follower 
amplifier 14, a horizontal selection transistor 16, and 
the like composed of, for example, MOSFET's (in the 
present embodiment, N channel MOSFET's are shown for 

30 example) arranged, in each pixel area Pll to P44. 

The circuit configuration of a pixel area Pmn, where 
m denotes the row number and n denotes the column number, 
is described below. The cathode side of the photodiode 10 
in the pixel area Pmn is connected to, for example, the 

35 source electrode of a reset transistor 12 composed of an 

N channel MOSFET and the gate electrode of the source 
follower amplifier 14. 
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The drain electrode of each reset transistor 12 is 
connected to a reset voltage supply line VRm to which a 
reset voltage VR is applied, and the gate electrode is 
connected to a reset signal line RSTm. The drain 
5 electrode of the source follower amplifier 14 is 

connected to the reset voltage supply line VRm, and the 
source electrode is connected to, for example, the drain 
electrode of the horizontal selection transistor 16 
composed of an N channel MOSFET. The gate electrode of 

10 each horizontal selection transistor 16 is connected to a 

horizontal selection line RWm to which a selection signal 
is supplied. The source electrode of each horizontal 
selection transistor 16 is connected to a vertical 
selection line CLn. 

15 The reset voltage supply line VRm and the horizontal 

selection line RWm are connected to a vertical scanning 
shift register/reset control circuit 4. By means of a 
shift register, which is not shown here but is provided 
in the vertical scanning shift register/reset control 

20 circuit 4, a selection signal is output sequentially to 

the horizontal selection line RWm at a fixed timing. 

Each vertical selection line CLn is connected to a 
signal common output line 30 via an amplifier /noise 
cancel circuit 6 and, for example, a column selection 

25 transistor 20 composed of an N channel MOSFET. A column 

selection signal is input sequentially from a horizontal 
scanning shift register 8 to the gate electrode of the 
column selection transistor 20, and by means of the 
amplifier/noise cancel circuit 6, the image data from 

30 which the fixed pattern noise has been removed is output 
sequentially to the signal common output line 30, then it 
is transmitted to an external system via an amplifier 32. 
The amplifier 32 is a gain variable amplifier, the 
amplification factor (gain) of which can be varied. 

35 Next, the operations of the CMOS image sensor 1 are 

briefly described below. First, when the reset transistor 
12 is turned on by a reset signal RST at a fixed timing, 
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the photodiode 10 is charged to a reset potential VR. 
Then the photodiode 10 begins to discharge in accordance 
with the incident light and the potential becomes lower 
than the reset potential VR. After a fixed time elapses, 
5 when a horizontal selection signal RW is output to the 
horizontal selection line RWm, the horizontal selection 
signal RW is input to the gate electrode of the 
horizontal selection transistor 16 connected to the 
horizontal selection line RWm, and the horizontal 

10 selection transistor 16 is turned on. In this way, the 

output voltage from the source follower amplifier 14 is 
output to the vertical selection line CLn as the image 
data in the pixel area Pmn. 

The CMOS image sensor in the present invention has a 

15 microprocessor 41, a D/A converter 44, and an A/D 
converter 45, in addition to the above-mentioned 
configuration. Within the microprocessor 41, there are 
provided as software a control section 42 that controls 
the CMOS image sensor 1 and a brightness/illumination 

20 flicker detection section 43 that detects the brightness 

and illumination flicker of the light image incident on 
the pixel from the output signal, which is the output of 
the amplifier 32 converted into digital signal in the A/D 
converter 45. The microprocessor 41 outputs data with 

2 5 which to set a timing (that is, the number of integral 
lines) for outputting a reset signal to the vertical 
scanning shift register /reset control circuit 4 according 
to the detected brightness and illumination flicker, and 
at the same outputs data with which to set a gain of the 

30 amplifier 32 to the D/A converter 44. In accordance with 

this, the storage time (number of integral lines) is set 
and the gain of the amplifier 32 is set. 

FIG. 5 and FIG. 6 are diagrams illustrating the 
automatic gain control in the present embodiment, 

35 corresponding to FIG.l and FIG. 2, respectively, wherein 
the frame frequency f is 30Hz. FIG. 5 shows the change in 
the number of integral lines during the automatic gain 



control in the present embodiment and FIG .6 shows the 
change in amplifier gain during the automatic gain 
control in the present embodiment. FIG. 7 shows the 
amplifier gains and the control values of the storage 
time when a fluorescent lamp is lit by a power source 
with a frequency of 50Hz (light emission period is 
100Hz), and FIG. 8 shows the amplifier gains and the 
control values of the storage time when a fluorescent 
lamp is lit by a power source with a frequency of 60Hz 
(light emission period is 120Hz). 

In the present embodiment, even in the 341 to 2000 
range of the value of brightness, the number of integral 
lines (storage time) is varied step by step, and the 
amplifier gains are also varied so that the total 
sensitivity varies smoothly in accordance with the value 
of brightness, as is obvious from FIG. 5 and FIG. 6. When 
the light emission period is 120Hz, the storage time 
varies step by step as 1/120 sec, 2/120 sec, 3/120 sec, 
4/120, and when the light emission period is 100Hz, the 
storage time varies step by step as 1/100 sec, 2/100 sec, 
3/100 sec. When the storage time varies step by step, the 
integral time varies by 6dB at most, therefore, the 
amplifier gains are adjusted in the meantime. 

The brightness/illumination flicker detection 
section 43 of the processor 41 detects the brightness and 
the illumination flicker of a light image incident on a 
pixel in the manner described below. The control section 
42 determines the number of integral lines (storage time) 
and the amplifier gain from the table in FIG. 7 and FIG. 8 
according to the detected brightness and illumination 
flicker, outputs data to direct the number of integral 
lines (storage time) to the vertical scanning shift 
register/reset control circuit 4, and outputs data to 
direct the amplifier gain to the D/A converter 44. For 
example, when the illumination flicker is 50Hz and the 
value of brightness is 500, the storage time is set to 10 
ms (160 lines) and the amplifier gain is set to 4db in 



accordance with the table in FIG. 7. 

The detection of the illumination flicker in the 
brightness/illumination flicker detection section 43 in 
the embodiments follows the method disclosed in the 
above-mentioned Japanese Unexamined Patent Publication 
(Kokai) No. 2002-330350. This method is briefly described 
below. 

FIG. 9 is a flow chart for detecting illumination 
flicker. First, the signal storage time of the CMOS image 
sensor is set to a signal storage time ts at which no 
flicker noise is caused by the illumination by a 
fluorescent lamp whose light emission frequency is 120Hz 
(step SI), when a light emission period of the 
fluorescent lamp is 1/120 sec, the luminance variations 
in a frame due to the flicker noise are 1/120 sec and 
periodic. Therefore, 1/120, 2/120, 3/120, and 4/120 sec, 
which are integer multiples of the period, and less than 
the 1/30 sec frame period of the CMOS image sensor, are 
the values which the signal storage time can take without 
causing flicker noise by the illumination of the 
fluorescent lamp lit at a light emission frequency of 
120Hz. 

Next, the average luminance of the image data is 
detected for each frame in a fixed average luminance 
detection area denoted by reference number 50 on the 
image surface shown in FIG. 10 (step S2). In FIG. 10, 
average luminance detection areas 50, shown by slash 
lines, are shown at three positions at almost equal 
intervals corresponding to d2 horizontal selection lines. 
The average luminance detection area 50 is composed of 
plural pixels connected to a fixed number of adjacent 
horizontal selection lines. In addition, the number dl of 
horizontal selection lines in each average luminance 
detection area 50 must be adjusted to a number that is 
not an integer multiple of the period of the luminance 
variations caused by the flicker noise. 

Moreover, it is desirable that the average luminance 
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detection area 50 is provided at one to three positions 
in a frame at intervals of 3/10 times the width V 
corresponding to the total horizontal selection lines. 
Next, the difference in the average luminance 
5 between each frame (for example, between the frame in 
question and the immediately preceding frame) is 
calculated (step S3), Then whether the difference in the 
average luminance exceeds a fixed threshold is judged 
(step S4). If the difference in the average luminance 

10 exceeds the threshold, it is judged that the light 
emission frequency of the fluorescent lamp is 100Hz 
because the luminance differs from frame to frame (step 
S5). If not, it is judged to be 120Hz. 

The illumination flicker can be judged in the manner 

15 described above. 

In addition to the detection method of the 
illumination flicker described above, it is possible to 
detect illumination flicker by, for example, providing a 
light receiving device that receives light in proportion 

20 to incident light in part of a solid-state image sensor 
and by detecting the change in amount of light received. 

In accordance with the present invention, it is 
possible to realize a solid-state image sensor that can 
perform sensitivity adjustment in a wide range without 

25 causing flicker or stripes due to the illumination by a 

fluorescent lamp, as described above. 



